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Performance and improvement ratings for Massachusetts public schools and districts are issued every two years. Ratings 
are based on student performance on Massachusetts Comprehensive Assessment System (MCAS) tests. Ratings are used 
to track schools’ progress toward meeting the goal of all students achieving proficiency in English language arts and 
mathematics. We are working to achieve this goal by 2013-2014. 


School and district performance and improvement ratings are used to identify instances of low performance and schools 
with exemplary improvement. The school and district performance rating process is the first stage of a multi-tiered 
process of school and district accountability. Ratings are used to determine whether adequate yearly progress (“AYP”) has 
been made. The Department uses ratings to guide the selection of schools and districts for further review by the 
Massachusetts Department of Education and the Office of Educational Quality and Accountability. Schools and districts 
that fail to meet State performance standards may be reviewed to determine under-performance and assess whether State 
intervention is needed to direct improvement efforts. Schools and districts that demonstrate significant improvement may 
be selected for recognition and service in the Commonwealth Compass Schools program. 


Cycle II Ratings 

Cycle II ratings are based on MCAS English language arts (ELA) and mathematics test results for 2001land 2002. Student 
performance data for the two years under review are combined. Separate ratings are given for ELA and mathematics. 
Improvement is rated by comparing performance in 2001 and 2002 with a school’s or district’s performance during 1999 
and 2000, the baseline years for Cycle II. 


For Cycle II, schools will receive separate ratings for elementary, middle, and high school performance and improvement, 
based on grades 4, 7, 8, and 10 ELA and mathematics results. Districts will receive composite ratings, based on 
performance across grades, for ELA and mathematics. Grade 7 results for 2002 have been combined with grade 8 results 
for 2001 to determine middle grades ELA proficiency indices and ratings for Cycle II. Grade 7 ELA results for 2001, the 
first year in which MCAS tests were given at that grade level, were not factored into the calculation of Cycle II ratings. 
MCAS results for grade 3 reading and grade 6 mathematics will be incorporated into the rating system for Cycle III. 


Introducing the Massachusetts Proficiency Index 

To accommodate changes in the MCAS testing program and begin aligning the Massachusetts School and District 
Accountability System with requirements of the federal No Child Left Behind Act, Cycle II performance and 
improvement ratings have been calculated using a new “proficiency index.” The proficiency index is a measure of the 
extent to which students have attained or are progressing toward proficiency in ELA and mathematics. A school’s or 
district’s proficiency index is determined by the number of students scoring at each MCAS performance level, as shown 
below in Table 1. A schocl’s or district’s improvement rating is determined by comparing its proficiency index at the end 
of a rating cycle with its proficiency index for the two-year baseline for that rating cycle. 


Calculating a School or District Proficiency Index 

Proficiency points are awarded to a school or district for each student in the MCAS test group during the rating period. 
The number of points awarded depends on the student’s performance level. The proficiency index is obtained by dividing 
the total points awarded by the number of students in the test group, as indicated in the example below. 
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Performance Ratings 


Once the proficiency index is calculated for each content area, the index score is matched to one of the six performance 
rating categories listed below in Table 2. 


To permit valid comparisons of performance using the new proficiency index as the unit of measurement, the Department 
has calculated proficiency indices for MCAS ELA and mathematics results for the years 1998 through 2001. The student 
performance standards and scales used to score 2001 and 2002 MCAS tests were applied to student results from prior 
years’ tests to complete this “back-mapping” process. Back-mapped proficiency index results for all Massachusetts 
schools and districts are available on the Department’s web-site at www.doe.mass.edu/ata/pi. 


Fable 2 Table 3. 
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An improvement target for each subject 1s determined for each school and district for each rating cycle. The amount of 
proficiency index increase a school or district is expected to achieve during a particular rating cycle depends on the gap 
between that school’s or district’s baseline proficiency index and a proficiency index of 100 (the year 2014 performance 
target for all Massachusetts schools and districts). Proficiency index and performance target calculations are rounded to 
the nearest tenth. 
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Improvement Targets 


Improvement targets for Cycle II were obtained by calculating the difference between schools’ and districts’ proficiency 
index baselines from combined 1999 and 2000 MCAS results and 100 points, then dividing the difference by seven, the 
number of two-year cycles between 2001 and 2014. A rating that reflects the extent of change in the end-of-cycle 
proficiency index compared to the baseline proficiency index is assigned using the rating criteria detailed in 

Table 3 above. Figure 1, below, shows the score ranges corresponding to each improvement rating for a sample school 
with a proficiency index for ELA or mathematics of 51 points. 
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Figure 1. 


Minimum Sample Size for Performance and Improvement Ratings 


Ratings are issued whenever a school or district meets the minimum size requirements for statistically reliable 
determinations. Performance ratings are issued when schools have 20 or more students per year, on average, in the test 
group and no fewer than 15 students in any one year. Jmprovement ratings are issued, using standard rating rules, when 
schools and districts have test results for 50 or more students per year on average during the years under review, and no 
fewer than 40 students in any one year. 


When a school or district has more than 20 but less than 50 students per year on average in the test group improvement 
Tatings are issued when a reliable finding can be generated by applying an adjusted error band. The standard error band 
used in determining improvement ratings for schools with 50 or more students per year in the test group is 2.5 proficiency 
‘index points. An error band of up to 4.5 points may be used to compute ratings for schools with a small sample size. Error 
bands ranging from 1.0 to 4.5 points, depending on sample size, are applied in determining district ratings. 


Adequate Yearly Progress 


Adequate Yearly Progress (AYP) is the amount of improvement toward student proficiency that a school or district must 
demonstrate each year, on average, to steadily close performance gaps and by 2014 have all students performing at 
proficient and advanced levels in English language arts and mathematics. AYP is determined separately for ELA and 
mathematics. The amount of progress that is deemed to be “adequate” depends on a school or district’s performance level 
Telative to State performance targets for each rating cycle, and the extent to which a school has improved relative to its 
baseline for that rating period. Schools that fail to make adequate yearly progress in English language arts, mathematics 
or both subjects are subject to district and State level sanctions and receive special assistance and support. 


State performance targets for English language arts and mathematics for Cycle II were determined in accordance with the 
No Child Left Behind Act’s guidelines for establishing our State’s starting points for measuring progress toward meeting 
the Act’s 12-year performance goals. The Cycle II State performance target for ELA is a proficiency index of 70.7. Our 
Cycle II State performance target for mathematics is a proficiency index of 53. 


A school or district with a Cycle II proficiency index in both ELA and mathematics above these targets is deemed to have 
made AYP during 2001 and 2002, irrespective of its improvement ratings for this cycle. Schools and districts with 
performance below the State performance targets in either ELA or mathematics must demonstrate improvement to avoid 
district and State sanctions. A school or district receiving a Cycle II improvement rating of Improved Below Target, On 
Target, or Above Target is considered to have made AYP in that subject, notwithstanding the fact that its proficiency 
index 1s below the State target. 
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*The blue lines indicate the Cycle II State performance targets “: ae language arts and mathematics. 


Rating Consequences 


e Schools with the lowest performance in English language arts and mathematics whose proficiency index in either 
subject declined or showed no change [Action Guide cells 21, 22, 26, and 27] may be referred further review and have 
top priority for district and State support and assistance. 

Title 1 schools that do not make AYP in one or both subjects [Action Guide cells 16, 17, 21, 22, 26, and 27] for two 
consecutive years are designated Schools In Need of Improvement. Title 1 requirements for improvement planning, 
parental choice, and supplemental services apply to schools with this designation. 

All schools with ow, very low, or critically low performance during Cycle II [Action Guide cells 16 — 30] will be 
given priority for State support, training and assistance. District leaders are expected to provide oversight, guidance 
and support for low performing schools. 

Schools that made significant improvement or demonstrated very high performance during Cycle II [Action Guide 
cells 2-5, 9, 10, 14, 15, 20, 25] are candidates for recognition and may apply for participation in the Commonwealth 
Compass Schools program. 


For additional information on Cycle II ratings and their consequences please visit www.doe.mass.edu/ata. 


Report of School and District Cycle II Performance Ratings 
November 25, 2002 


The following report includes the Cycle II school and district performance ratings that 
have been issued as of the report date. In cases where schools have requested corrections 
to their 2002 MCAS data, and the corrections, if made, could impact the ratings, the 
ratings have been held and will be issued once the data have been reviewed. 


The baseline proficiency index (PI) is based on 1999 and 2000 MCAS data. The Cycle II 
PI is based on 2001 and 2002 data. Adequate Yearly Progress (AYP) determinations have 
been made for schools only. 
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